1 

Myopic Coding in Multiterminal Networks 

Lawrence Ong, Student Member, IEEE and Mehul Motani, Member, IEEE 
Electrical and Computer Engineering Department, 
National University of Singapore, Singapore 119260. 
Email: lawrence.ong@cantab.net, motani@nus.edu. sg 



Abstract 

This paper investigates the interplay between cooperation and achievable rates in multi-terminal networks. 
Cooperation refers to the process of nodes working together to relay data toward the destination. There is an inherent 
tradeoff between achievable information transmission rates and the level of cooperation, which is determined by 
how many nodes are involved and how the nodes encode/decode the data. We illustrate this trade-off by studying 
information-theoretic decode-forward based coding strategies for data transmission in multi-terminal networks. 
Decode-forward strategies are usually discussed in the context of omniscient coding, in which all nodes in the 
network fully cooperate with each other, both in encoding and decoding. In this paper, we investigate myopic 
coding, in which each node cooperates with only a few neighboring nodes. We show that achievable rates of myopic 
decode-forward can be as large as that of omniscient decode-forward in the low SNR regime. We also show that when 
each node has only a few cooperating neighbors, adding one node into the cooperation increases the transmission 
rate significantly. Furthermore, we show that myopic decode-forward can achieve non-zero rates as the network size 
grows without bound. 

Index Terms 

Achievable rates, decode-forward, multiple-relay channel, multi-terminal network, myopic coding. 

I. Introduction 

A. Wireless Networks 

Wireless networks have been receiving much attention recently by both researchers and industry. The main 
advantage of wireless technology to users is the seamless access to the network whenever and wherever they are; to 
service providers, easier deployment, as no cable laying is required. Examples of wireless networks include cellular 
mobile networks, Wi-Fi networks, and sensor networks. A large amount of research has been carried out recently 
on various aspects of wireless networks, including power saving [1], [2], routing [3], [4], [5], transport capacity 
[6], [7], and connectivity [8]. In this paper, we focus on transmission rates in multi-terminal wireless networks. 

Analyzing transmission rates in multi-terminal networks is not easy. Consider the single-relay channel [9], [10], 
a channel consisting of one source, one relay, and one destination. Even for this simple three-terminal network, 
the capacity is not known except for a few special cases, e.g., the degraded relay channel [9]. This hints at the 
difficulty of analyzing multi-terminal networks. We attempt to investigate an excerpt of the multi-terminal network 
by looking at data transmission from a single source to a single destination, from multiple sources to a single 
destination, and from a single source to multiple destinations, with the help of relay(s). Appropriate models for 
these types of networks are the multiple -relay channel [11], [12] (an extension of the single -relay channel), the 
multiple-access relay channel [13], [14], and the broadcast relay channel [15] respectively. The reason for using 
relays, which have no data of their own to send, in the network is as follows. Direct transmission from the source 
to a far-situated destination may require high transmission power (due to the path loss of electromagnetic wave 
propagation). Since wireless networks operate over a shared medium, this can create direct interference to other 
users. Transmitting data via intermediate relays, using multiple-hop routing or cooperative relaying, can help to 
decrease the transmit power and reduce multi-user interference. 

A portion of the results in this paper has been presented at the 39th Conference on Information Sciences and Systems, John Hopkins 
University, Baltimore, MD, 16-18 March, 2005, and the IEEE International Symposium on Information Theory, Adelaide Convention Centre, 
Adelaide, Australia, 4-9 September, 2005. 
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B. Point-to -Point Coding 

A common approach to data transmission is to abstract the wireless network into a communication graph, with 
an edge connecting two nodes if they can communicate. Data communication happens by identifying a route, which 
is a sequence of nodes that connect the source to the destination. Each node sends data to the next node in the 
route and decodes data from the previous node in the route. Transmissions of other nodes are treated as noise. We 
call this coding strategy point-to-point coding in a multi-terminal network. This way of transmitting data from the 
source to the destination is commonly called multi-hop routing in the communications and networking literature. 
The terms coding and coding strategy are used interchangeably in this paper. 

C. Omniscient Coding 

Point-to-point coding ignores the inherent broadcast nature of the wireless channel, i.e., that a node can hear 
transmissions meant for other nodes, and thus it can act as a relay for them. Clearly, the best thing to do is for all 
nodes to cooperate, helping the source to send its data to the destination. This requires every node to be aware of the 
presence of other nodes and to have knowledge of the processing they do. We refer to coding strategies that utilize 
the global view and complete cooperation as omniscient coding. In the literature, omniscient coding strategies were 
investigated for multi-terminal networks, e.g., the multiple-access relay channel, the broadcast relay channel [16], 
[17], and the multiple -relay channel [7], [12], [18]. While the rates achievable by omniscient coding strategies are 
higher than those achievable by point-to-point coding strategies in these channels, there are a number of practical 
difficulties in implementing complete cooperation, e.g., (i) designing codes based on omniscient coding is more 
difficult as it involves the optimization of the whole network, (ii) the failure of one node affects the decoding of 
all other nodes, and (iii) all nodes need to be synchronized (for some coding strategies). 

D. Myopic Coding 

In view of these practical issues, we investigate myopic coding, coding strategies with constrained communica- 
tions, e.g., node have a local view of the network, and limited cooperation. Myopic coding positions itself between 
point-to-point coding and omniscient coding. In myopic coding, communications of the nodes are constrained in 
such a way that a node communicates with more than two nodes (as opposed to point-to-point coding) but not with 
all the nodes (as opposed to omniscient coding) in the network. Myopic coding incorporates local cooperation. It 
allows cooperation among neighboring nodes to increase the transmission rate compared to point-to-point coding. 
On the other hand, it partially solves the practical difficulties encountered in omniscient coding. In this paper, we 
illustrate myopic coding by using decode-forward based coding strategies. 

We derive achievable rates of myopic coding strategies for the multiple -relay channel, the multiple-access relay 
channel, and the broadcast channel. We compare the performance of myopic coding to that of omniscient coding 
in these channels and show the trade-off between achievable rates and complexity. 

E. Contributions 

The primary aim of this work is to understand how to communicate data from sources to destinations through a 
network of wireless relays. This work is a step in the direction of designing efficient protocols and algorithms for 
wireless networks. We ask the following questions which we will partially answer in the rest of this paper: 

• What rate regions are achievable in multi-terminal channels (such as the multiple -relay channel, multiple-access 
relay channel, and the broadcast relay channel) in which every node has only a localized or myopic view of 
the network? 

• What is the value of cooperation? In other words, what is the impact on the performance, in terms of 
transmission rates, when communications among the nodes are constrained compared to the case when they 
are unconstrained? 

Answering these questions leads to the main contributions of this paper, which are: 

• We construct random codes for myopic decode-forward, i.e., decode-forward coding strategies [12] with myopic 
outlook, for the discrete memoryless multiple-relay channel and derive achievable rates of the strategies. 

• We compute achievable rates of myopic decode-forward and omniscient decode-forward for the Gaussian 
multiple -relay channel. 
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• Comparing the myopic version and the omniscient version of decode-forward, we show that including a few 
nodes into the cooperation increases the transmission rate significantly, often making it close to that under full 
cooperation. In other words, sometimes more cooperation yields diminishing returns. 

• We show that in the multiple -relay channel, myopic decode-forward can achieve non-zero rates as the network 
size grows to infinity. 

• We derive achievable rate regions of myopic decode-forward for the multiple-access relay channel and the 
broadcast relay channel. On Gaussian channels, we show that under certain conditions, the performance of 
myopic coding can be close to that of omniscient coding. 

F Paper Outline 

The rest of the paper is organized as follows. In Section JIJ we define myopic coding and give examples of 
two myopic coding strategies. We present the advantages of myopic coding compared to omniscient coding. In 
Section JIIJ we investigate myopic coding in the multiple-relay channel. We first define the channel model and then 
derive achievable rates of two-hop myopic decode-forward. We then compare achievable rates of one-hop myopic 
decode-forward, two-hop myopic decode-forward, and omniscient decode-forward for the multiple-relay channel. 
We show that, in the five-node and the six-node Gaussian multiple -relay channels, when the nodes transmit at low 
signal-to-noise ratio (SNR), achievable rates of the two-hop coding are close to those of the omniscient coding. In 
Section IIII-F1 we extend the analysis to the general £>hop myopic decode-forward for the T-node multiple-relay 
channel, where k can be any positive integer from 1 to T — 1 and T is the number of nodes (including the source, 
the relays, and the destination) in the channel. In Section MI-HI we investigate myopic coding in a large network, 
meaning that the number of nodes grows to infinity. We show that even with a restricted view, in which a node 
treats the transmissions of the nodes beyond its view as noise, achievable rates are still bounded away from zero. 
In Sections [IV] and [V] we investigate myopic decode-forward for two other channels, namely the multiple-access 
relay channel and the broadcast relay channel. We show that under certain conditions, achievable rates of myopic 
decode-forward can be as large as that of omniscient decode-forward. We conclude the paper in Section [VT] 

II. Myopic Coding 

A. What is Myopic Coding? 

Recall that we categorize a coding strategy as omniscient if all nodes have a global view of the network and 
can cooperate completely. Now, we define myopic coding. This is an informal definition which will be made more 
precise later in the paper. 

Informal Definition 1: A myopic X coding strategy is a constrained version of the corresponding omniscient 
X coding strategy. The constraint in myopic coding is such that every node cooperates with only a few other 
nodes. This cooperation can be in the form of transmitting to another node, processing (e.g., decoding, amplifying, 
quantizing) or canceling the transmissions from another node. 

We note that a myopic coding strategy is defined with respect to an omniscient coding strategy. Though there 
is no fixed way of constraining an omniscient coding strategy, the idea is to limit the processing at the nodes 
by limiting the number of neighbors a node communicates and cooperates with. Myopic coding aims to achieve 
practical advantages, e.g., lower computational complexity, robustness to topology changes, and fewer storage/buffer 
requirements. 

To illustrate myopic coding, we now briefly discuss two myopic coding strategies for the multiple-relay channel, 
namely myopic decode-forward and myopic amplify-forward. 

B. Myopic Decode-Forward for the Multiple-Relay Channel 

Let us consider the decode-forward coding strategy for the multiple -relay channel by Xie and Kumar [12], in 
which every message is fully decoded at and forwarded by the relays. It is also known as the decode-and-forward 
strategy. In this strategy, block Markov encoding (irregular block Markov encoding^ [9] and regular block Markov 
encoding 1 [19]) can be used. In the Gaussian channel, a node splits its total transmission power between sending new 

'We use the terminology in [18]. Note that the terms were not used in the original paper but subsequently used in later papers. 




Fig. 1: Omniscient decode-forward for the five-node Fig. 2: Two-hop myopic decode-forward for the five- 
Gaussian multiple-relay channel. node Gaussian multiple -relay channel. 

information and repeating what the relays in front (downstream, i.e., toward the destination) send. For decoding, 
successive decoding 1 [9] can be used for irregular Markov encoding; backward decoding [20] or sliding window 
decoding 1 [21] can be used for regular block Markov encoding. In the Gaussian channel, a node decodes signals from 
all the nodes behind (upstream, i.e., toward the source). At the same time, it cancels interfering transmissions from 
all the nodes in front. Since all the nodes fully cooperate, we term this coding strategy omniscient decode-forward. 

Now, we use an example to illustrate how each node cooperates with all other nodes in omniscient decode-forward. 
Consider a five-node Gaussian multiple-relay channel (the formal definition can be found in Section IIII-CI ). Using 
omniscient decode-forward, a node transmits to all the nodes in front. Fig. [TJ depicts the transmissions of the nodes. 
Let all Ui,i = 1,2,3,4, be independent random variables. When node 4 transmits C/4 to node 5, node 3 splits its 
power, transmitting new information (C/3) to node 4 and helping node 4 to transmit another copy of what node 4 
transmits (C/4) to node 5. Similarly, nodes 1-3 split their power to transmit new information and old information 
(the same information of what the nodes in front transmit). In decoding, a node decodes the transmissions from 
all nodes behind. For example, node 5 decodes all transmissions from nodes \-A. In addition, a node cancels all 
transmissions from the nodes in front when it decodes. For example, when node 2 decodes U\ from node 1, it 
cancels C/3 and C/4 from node 3, C/4 from node 4, as well as U2, C/3, and C/4 from node 1. 

Now, we consider a myopic version of the omniscient decode-forward in which nodes are limited in how much 
information they can store and process. We define k-hop myopic decode-forward for the multiple -relay channel as 
follows. 

Definition 1: k-hop myopic decode-forward for the multiple-relay channel is a constrained version of omniscient 
decode-forward, and the constraints are as follows. 

• In encoding, a node must transmit messages that it has decoded from at most the past k blocks of received 
signal. 

• In decoding, a node can decode one message using only k blocks of received signal. 

• A node can store a decoded message in its memory over at most k blocks. 

At the first glance, the above constraints for myopic decode-forward do not seem to include the view of a node 
or how many other nodes a node can communicate with. However, these are embedded in the definition itself. 
The constraints automatically restrict the number of nodes a node can cooperate with. Furthermore, the restrictions 
stem from practical advantages of having fewer processing and storage requirements at the nodes, which are the 
motivations behind myopic coding. 

Now, let us consider two-hop myopic decode-forward. The encoding and the decoding processes at the nodes in 
the five-node multiple -relay channel are as follows (refer to Fig. [2]) 

• Node 1 transmits U\ and U2, node 2 transmits U2 and C/3, etc. 

• Node 5 decodes C/3 and C/4, node 4 decodes U2 and C/3, etc. 

• During decoding, node 2 cancels U2 and C/3, node 3 cancels C/3 and C/4, etc. 

We note that this encoding technique is different from [7, Fig. 1], in which the source and the relay transmit 
independent signals (hence no coherent combining is possible) while the relays and the destination decode trans- 
missions from all nodes behind. The decoding technique in [7] is only possible under omniscient coding as a node 
decodes each message using the received signals from all upstream nodes, possibly over a large number of blocks. 

In myopic decode-forward for the multiple-relay channel, we use the concept of regular block Markov encoding 
and sliding window decoding. However, the encoding and the decoding techniques differ from that found in the 



5 



literature as the nodes have limited views. It is noted that myopic coding captures point-to-point coding and 
omniscient coding as special cases. In particular, /c-hop myopic decode-forward for the multiple-relay channel 
where k = 1 is point-to-point coding and k = T — 1 (T is the number of nodes in the channel) omniscient 
decode-forward. 

The reader is reminded that the term "hop" used here does not carry the same meaning as it does in multi-hop 
routing. The term hop is best understood by looking at the sequence in which the messages are decoded, e.g., if 
the messages are decoded by node i followed by node j, then node j is node i's next hop. 

We say that a set of nodes V are in the view of node i if node i processes (e.g., decodes, amplifies, or quantizes) 
or cancels the transmissions from all the nodes in V. 

C. Myopic Amplify-Forward for the Multiple -Relay Channel 

Next, let us consider the amplify-forward strategy for the multiple -relay channel by Yuksel and Erkip [22]. We 
will use the one-source, two-relay, one-destination network as an example. Consider the "5 + R\(S) + i?2(5', R±)" 
scheme [22, Table I]. In this scheme, the transmissions are split into three blocks. In block 1, the source transmits 
to both relays and the destination (hence the notation S). In block 2, relay 1 normalizes its received signal from the 
source in block 1 and forwards the normalized received signal to relay 2 and the destination (hence the notation 
Ri(S)). Relay 2 combines the signals that it has received in blocks 1 and 2, normalizes to its own power value, 
and transmits the combined signal in block 3 (hence the notation i?2(<S, Ri)). The destination then decodes using 
the three blocks of received signal (hence the notation S + R\(S) + R2{S, Ri)). We term this coding strategy 
omniscient amplify-forward, as each node cooperates with all other nodes. 

Now, let us consider a myopic version of the amplify-forward strategy. It has been noted in [22] that relay 2 
can choose to listen to only relay 1 (which transmits in block 2) and forwards only this received signal to the 
destination (the notation used is R2(R\))- Instead of decoding over three blocks, the destination can choose to 
decode only from relay 2 (which transmits in block 3). We see that in this scheme, a node listens to only one node 
and forwards to another node. Hence, we term this strategy one-hop myopic amplify-forward. One can similarly 
construct two-hop myopic amplify-forward, and so on. 

D. Practical Advantages of Myopic Coding 

In this section, we discuss a few practical advantages of myopic coding compared to omniscient coding. 
These include simpler code design, increased robustness, reduced computation and memory requirements, and 
local synchronization. Though the analyses of myopic coding in this paper are based on information-theoretic 
achievable rates (in Shannon's sense), the practical advantages here are relevant to code designs based on these 
strategies (myopic or omniscient, decode-forward or amplify-forward, etc.). That researchers are interested in 
practical implementations of information-theoretic cooperative strategies is apparent in the recent work that has 
been proposed in this direction. There are various codes designed based on omniscient decode-forward for the 
single -relay channel [23], [24], [25], [26] and the multiple-relay channel [27], [28], [29]. One may design myopic 
versions of these codes to reap the practical advantages discussed in this section. 

Looking closely at the LDPC codes using parity forwarding (based on omniscient decode-forward) for the 
multiple-relay channel [27], we see that the complexity of designing codes grows with the number of relays. This 
means that constructing codes in which all nodes cooperate can be more difficult compared to designing codes 
in which nodes only cooperate with neighboring nodes. This technique of utilizing local knowledge (or limited 
cooperation) is prevalent in other wireless network problems, e.g., cluster-based routing [30], whereby nodes are 
split into clusters, and routes are optimized locally. 

Myopic coding schemes are more robust to topology changes than the corresponding omniscient coding schemes. 
For example, consider cancellation of the interference from downstream nodes. In omniscient coding, a node needs 
to have the knowledge or an estimate of what every downstream node transmits in order to cancel it. Any error in 
the cancellation (due to topology changes or node failures not known to the decoder) will affect the decoding and 
thus the rate. In myopic coding, nodes only cancel the interference from a few neighboring nodes. This means that 
topology changes or node failures beyond a node's view are less likely to affect its decoding. In Appendix U we 
give another example to show how node failures affect more nodes in myopic coding than in omniscient coding. 
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Fig. 3: The T-node multiple -relay channel. 



In addition, the encoding and decoding computations at each node under myopic coding can be less. Since a 
node only needs to transmit to and decode from a few nodes, the node encodes fewer data for its transmissions 
and decodes fewer data from the received signals. 

Furthermore, since the nodes need to buffer fewer data for encoding, interference cancellation, and decoding, less 
memory is required for buffering and codebook storage. Consider the five-node Gaussian multiple-relay channel. 
Using omniscient decode-forward, node 1 encodes a message four times over four blocks, using different power 
splits. Node 5 buffers four blocks of its received signal to decode one message. The buffer grows as the number 
of nodes in the network increases. On the other hand, using myopic decode-forward, the nodes buffer fewer blocks 
of received signal, and the buffer size for each node is independent of the number of nodes in the network. 

Myopic coding mitigates the need for synchronization of the entire network. Under omniscient decode-forward, 
all the nodes might need to be synchronized. On the other hand, under myopic coding, a node only needs to 
synchronize with a few neighboring nodes. Hence, synchronization can be done locally. 

In brief, myopic coding can increase the robustness and scalability of the network. In the next section, we analyze 
the performance of myopic coding in the multiple -relay channel using the decode-forward coding strategy. 

III. Myopic Coding in the Multiple Relay Channel 

In this section, we construct random codes for myopic decode-forward for the multiple-relay channel and compare 
the performance of these myopic coding strategies to the corresponding omniscient coding strategy. 

A. Channel Model 

Fig. [3] depicts the T-node multiple -relay channel, with node 1 being the source and node T the destination. Nodes 
2 to T — 1 are purely relays. Message W is generated at node 1 and is to be sent to node T. A multiple-relay 
channel can be completely described by the channel distribution 

P*(y2,V3, ■ ■ .,Vt\xi,X 2 , . . . ,X T -l) (1) 

on y 2 x 3% x • • • x y?, for each (xi,x 2 , ■ ■ ■ ,xt-i) E X± X X 2 x ■ ■ ■ x Xt-i- In this paper, we only consider 
memoryless and time invariant channels [18], which means 

P(V2i, VTi\x{, Xr_l,3/2 _1 , • • • , = P*{V2i, • • • , VTiWi, X(T-l)i), (2) 

for all i. We use the following notation: x\ denotes an input from node i into the channel; Xjj denotes the j-th input 
from node i into the channel; yij denotes the j-th output from the channel to node i; and x\ = xti,x t 2, • • • , xu- 
We denote the T-node multiple -relay channel by the tuple 

(x-l x •■■ X X T -i,p*(y 2 , ■ ■ ■ ,Vt\xi, . . . ,x T -i),y2 x ••• x y T y (3) 
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B. Notation and Definitions 

In the multiple-relay channel, the information source at node 1 emits random letters W, each taking on values 
from a finite set of size M, that is w £ {1, M} = W. We consider each n uses of the channel as a block. 
Definition 2: An (M, n) code of a T-node multiple-relay channel comprises: 

• An encoding function at node 1, f\ : W — > which maps a source letter to a codeword of length n. 

• n encoding functions at node t,t = 2,3, . . . ,T — 1, : X _1 — ► ^t,« = 1,2, ...,n, such that xu = 
fu{ya,yt2, ■ ■ ■ , 2/t(i-i))> which map past received signals to the signal to be transmitted into the channel. 

• A decoding function at the destination, gx : 3^t — ► W, such that it) = gritSx)* which maps received signals of 
length n to a source letter estimate. 

Definition 3: Assuming that the source letter W is uniformly distributed over {1,...,M}, the average error 
probability is defined as 

P e = Pr{W / W). (4) 
We denote the estimated i-th source letter at the destination as Wi. 
Definition 4: The rate 

R<-\ogM (5) 

n 

is achievable if, for any e > 0, there is at least one (M, n) code such that P e < e. 

The following definition and lemma are taken from [31, p. 384] and [31, p. 386] respectively. 

Definition 5: Consider a finite collection of random variables (Xx, X%, ■ ■ ■ , Xk) with some fixed joint distribution 
p(xi, %% . . . , Xk)- Let S denote an arbitrarily ordered subset of these random variables, and consider n independent 
copies of S. 

n 

Pr{S = s} = []Pr{S i = Sl }. (6) 
i=i 

The set A™ of e-typical n-sequences (xi,X2, . . . , Xfc) is defined as 



(V) 



^(X 1 ,^ 2 ,...,X fe ) = |(x 1 ,x 2 ,...,x fe ): ~logp(s) - H(S) < e, C {X x , X 2 , . . . , X k }\. 
Lemma 1: For any e > and for sufficiently large n, < 2 n ^ H ^ +e ^ 

Throughout this paper, we follow the notation for node permutation used in [21]. Let T be the set of all relay 
nodes, T = {2, 3, . . . , T - 1}. Let tt(-) be a permutation on T. Define 7r(l) = 1, ir(T) = T and ir(i : t) = 
{7r(z),7r(z + 1), . . . , vr(t)}. 



C. The Gaussian Multiple-Relay Channel 

In the T-node Gaussian multiple -relay channel, node t, t = 2, . . . , T, receives 

Y t = </\tXi + Z t , (8) 

i=l,...,T-l 

where X,- L , input to the channel form node i, is a random variable with fixed average power E[Xf] = Pi. Y t is the 
received signal at node t. Z t , the receiver noise at node t, is an independent zero-mean Gaussian random variable 
with variance N t . Xu is the channel gain from node i to node t. Xu depends on the antenna gain, the carrier 
frequency of the transmission, and the distance between the transmitter and the receiver. 

We consider Gaussian multiple-relay channels with fixed average transmit power at the source and at all relays. We 
note that using omniscient decode-forward, having a maximum average power constraint on every node is equivalent 
to having a fixed average transmit power constraint on the node, as the overall rate is a non-decreasing function 
of the average transmit power at any node, keeping the transmit power of other nodes constant. This is because a 
node decodes the transmissions from all upstream nodes and cancels the transmissions from all downstream nodes. 
So, the transmissions of all nodes are either used in decoding or canceled but are never treated as noise. However, 
under myopic coding, lowering the transmit power at certain nodes may help to reduce the interference at other 
nodes and increase the overall rate. Hence the maximum rate achievable by myopic decode-forward with maximum 
average power constraints on the nodes is lower bounded by that with fixed average power constraints. 
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We use the standard path loss model for signal propagation. The channel gain is given by 

\t = nttf, (9) 

where r] is the path loss exponent, and r] > 2 with equality for free space transmission, ft is a positive constant as 
far as the analyses in this paper are concerned. Hence, the received power at node t from node i is given by 

Pit = htPi = KdtfPi. (10) 

For the channel where all transmitters have the same power constraint, i.e., Pi = P, and all receivers have the 

p 



same noise power, i.e., N t = N, we define the signal-to-noise ratio (SNR) to be 1 



D. Achievable Rates 

In this section, we investigate achievable rates of two myopic decode-forward coding strategies and the omniscient 
decode-forward coding strategy. 

1) Omniscient coding: First, we consider achievable rates of omniscient decode-forward. Xie and Kumar [12] 
proposed a decode-forward coding strategy for the multiple -relay channel. They showed that the following rate is 
achievable, which is higher than that in [7]. 

R < max max mm I(X n n :t y,Y n u +1 )\X n r t +i ;T -i)) (Ha) 

tt(-) p(-) l<t<± — 1 

— -^omniscient' (lib) 

The first maximization allows us to arrange the order in which data flow through the relay nodes. The second 
maximization is over all possible distributions p(x±, ■ ■ ■ , xt-i) on X\ x • • • x Xt-i. The minimization is over 
all relays and the destination, where full decoding of the messages must be done. Since all the information must 
pass through each relay, the relay that decodes at the lowest rate becomes the bottleneck of the overall transmission. 
We note in the mutual information term that node 7r(i + l) receives the transmission from all nodes behind, X^H. t \. 
Since it knows what the nodes in front transmit (by the flow of data), it can cancel out their transmissions, as seen 
in the conditioned term X^u+VjT-i)- 

Now, we investigate achievable rates of myopic decode-forward coding strategies. We note that using decode- 
forward, all relays must fully decode the messages. We assume that the relays decode the messages sequentially. 

2) One-Hop Myopic Coding (Point-to-Point Coding): In one-hop myopic decode-forward, a relay node transmits 
what it has decoded from one block of received signal. This means a node transmits to only the node in the next 
hop. In decoding, a node decodes one message using one block of received signal. This means a node decodes 
from only one node behind. A node keeps its decoded message for one block, and it uses the last decoded message 
to cancel the effect of its own transmission. Using random coding [32], node ir(t) can reliably decode data up to 
the rate 

Rw{t) = I{X w ^_iy,Y w ^\X w ^), (12) 

for some p(xi)p(x 2 ) ■ • • p(xt-i), t G {2, ...,T}, and X n rp) = 0- Since all information must pass through all 
nodes in order to reach the destination, the overall rate is constrained by 

R < min R v (t)- (13) 
te{2,...,T} v ' 

Noting that the messages can flow through the relays in any order [21] and the nodes transmit independent signals, 
we have the following result. 
Theorem I: Let 

(x x x ••• x x T -i,p*(y2,---,yT\xi,...,x T - 1 ),y 2 x ••• xy T j 

be a memoryless multiple -relay channel. Under one-hop myopic decode-forward or point-to-point coding, the rate 
R is achievable, where 

i?<maxmax min I(X^u_iy Y w m \X w m) = i?i_ h0 p. (14) 
tt(-) p(-) te{2,...,T} \ j \ j \ j 

The outer maximization is over all possible node permutations and the inner maximization is taken over all joint 
distributions of the form 

p(xi, x T -i,V2, ...,yr)= p{xx)p(x 2 ) ■ ■ -p(x T -i) x p*{y 2 , yr\xi, xt-i)- 
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3) Two-Hop Myopic Coding: Instead of just transmitting to only its immediate neighbor, a node might want to 
help the neighboring node to transmit to the neighbor's neighbor. Under two-hop myopic decode-forward, a node 
can transmit messages that it has decoded in the past two blocks of received signals. That means in block i, a 
node transmits data that it has decoded in blocks i — 1 and i — 2. In decoding, it decodes one message using only 
two blocks of received signal. Two-hop myopic decode-forward achieves rates up to that given in the following 
theorem. 

Theorem 2: Let 

\XiX---X X T -i,p*{y2, ■ ■ ■ ,Vt\xi, . . . ,x T -i),y2 x ••• x]; T j 

be a T-node memoryless multiple -relay channel. Using two-hop myopic decode-forward, the rate R is achievable, 
where 

R < max max min I(U n n 2 ), Z^-ft-l); Y n(t)\U n ( t ), U n r t+1 )) (15a) 

tt(-) p(-) te{2,...,T} 

= -R2-hop, (15b) 

where U^^o) = ^tt(T) = £^r(T+i) = 0, for 7r(0) = and tt(T +1) = T + 1. The outer maximization is over all 
possible relay permutations and the inner maximization is taken over all joint distributions of the form 

p(xi,x 2 ■ ■ .,x T -i,u 1 ,u 2 . . .,UT-i,y2,V3 ■■■ ,yr) 

= P{Un(l))p(u n (2)) • ••p(« 7 r(T-l))p(a ; 7r(l)k7r(l)>«7r(2))p( a; 7r(2)l'"7r(2))«7r(3)) " " " PO^T-l) K(T-l)) 
X P*{V2, ■ ■ ■ ,Vt\xi, . . . ,X T -l). 

The proof of Theorem |2] can be found in Appendix |II1 

Using a particular probability distribution function on a coding strategy, we term the maximum rate at which 
a node can reliably decode the source messages the reception rate. For example, using one-hop myopic decode- 
forward, the reception rate at node ir{t) is R^m = I(X n ( t _iy 7 Y 7T ^\X 7T ^); using two-hop myopic decode-forward, 
the reception rate at node w(t) is R^ t) = I{U^ t _ 2) ,U^ t _ x y,Y^ t) \U^ t) ,U^ t+1 ))^ 

E. Performance Comparison 

In this section, we compare achievable rates of the two myopic coding strategies and the omniscient coding 
strategy for the Gaussian multiple-relay channel. 

1 ) Channel Setup: Consider a linear five-node channel, in which nodes are arranged in a straight line in the 
sense that for any i < j < k, dik = dij + djk- Node 1 is the source, nodes 2, 3, and 4 are the relays, and node 5 
is the destination. Node t, t = 2, 3, 4, 5, receives the following channel output, 

4 ; 

Y t = Y J ^d~ 1 n X l + Z t . (17) 
i=i 

In all analyses in this section, we use the following parameters: N 2 = N% = = N§ = N = 1W, k = 1, and 
7] = 2. 

Now, consider a point-to-point link. The rate at which information can be transmitted through a Gaussian channel 
(per channel use) from node i to node t is given by [31] 

^ log ( 1 + t)- <18) 

Throughout this paper, logarithm base 2 is used and hence the units of rate are bits per channel use. 

2) One-Hop Myopic Coding: In one-hop myopic decode-forward, node t transmits only to node t + 1. Let us 
first consider node 1. It sends X\ to node 2. Node 2 receives 

Y 2 = ^^X 1 + ^d^X z + ^d^X i + Z 2 . (19) 
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Node 2 decodes new messages from node 1 's transmission. From ([T2l) . the reception rate at node 2 is 

R 2 = I{X X -Y 2 \X 2 ) (20a) 

- log 2vre [nd^Ps + «d^P 4 + N 2 ] (20b) 

d u 2 P 1 



log 2vre nd l2 r 'P 1 + Kd 2 ^P 3 + Kd 2 %P± + iV 2 



log 



1 + 



1 + d^Ps + d 2 lP 4 



(20c) 



Here, we have substituted k = 1, r\ = 2, and A2 = 1W. The reception rates at nodes 3, 4, and 5 can be computed 
in similar way. Achievable rates of one-hop myopic decode-forward are 



R < min R t = R 

te{2,3,4,5} 



1 -hop • 



(21) 



We note that the message flow through the nodes in the order {1, 2, 3, 4, 5} gives the highest achievable rate in this 
network. 

Figs. 0] and [5] show achievable rates of one-hop myopic decode-forward for equal node spacing and the optimal 
node spacing respectively. In the latter, the spacing among the nodes is determined by brute force, with the constraints 
that all five nodes form a straight line (node i + 1 is in front of node i) and d\^ = 4. 

When the nodes are equally spaced, -Ri_h op is constrained by reception rates R 2 and i? 3 . In order to increase R 2 
and i?3, the distance d\ 2 and d 2 3 should be decreased. We see that this is indeed the case. The optimum values for 
d\ 2 and d 2 % are less than lm, as can be seen in Fig. [5] 

We see in Fig. [5] that as the average transmit power increases, the optimal d\ 2 and £^3 decrease while the optimal 
c?34 and CZ45 increase. This is because R 2 and R3 are significantly affected when P3 and P4 increase. Recall that 
in one-hop myopic decode-forward, a node treats the transmissions of all the nodes beyond its view as noise. For 
example, node 3 decodes from node 2, and treats the transmissions of nodes 1 and 4 as noise. Since there is no 
transmitting node in front of node 4, R4 and R§ are less affected by the increase of the transmit power. Hence, to 
compensate for the greater noise experienced by nodes 2 and 3 as the transmit power increases, d\ 2 and d 2 % are 
reduced to increase R 2 and R3. 

3) Two-Hop Myopic Coding: In two-hop myopic decode-forward, node t, t = 1, 2, 3, allocate at of its power to 
transmit to node t + 2 and (1 — at) of its power to node t + 1. Since there is only one node in front of node 4, it 
allocates all its power to transmit to node 5. The transmission by each node is listed as follows: 

• Node 4 sends X 4 = \JT\XJ 4 . 
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. Node 3 sends X 3 = y r a 3 ~P^U 4 + ^J{1 - a 3 )P 3 U 3 . 

. Node 2 sends X 2 = Va^W 3 + V (l - a 2 )P 2 U 2 . 

. Node 1 sends X 1 = ^P[\J 2 + ^{1 - aiJWi. 
Here, Ui,i = 1,2,3,4 are independent Gaussian random variables, each with unit variance, < ay < 1 for 
3 = 1,2,3. 

From d77l ), for fixed {cti, a 2 , a 3 }, the reception rate at node 2 is 



i? 2 = /([/ i; y 2 |[/ 2 ,[/3) 
i 



(22a) 



log 2ire 



Kd l2 v (l - «i)Pi + JKd 23 v a 3 P 3 + J Kd 2 ?P 4 + iV 2 



1 



log 2ire 



log 



1 + 



Kd T ?a 3 P 3 + J K d 24 v P 4 + N 2 



d^(l - a 1 )P 1 



1 + 



d 2 ia 3 P 3 + J d 2i 2 P A 



(22b) 



(22c) 



Here, we have substituted k = 1, rj = 2, and N 2 = 1W. The reception rates at nodes 3, 4, and 5 can be computed 
in a similar way. 

Minimizing over all reception rates and maximizing over all possible power splits, the overall achievable rate is 
given by 

it! < max min R t = i?2-hop- (23) 

{a u a 2 ,az} ie{2,3,4,5} 

We note that the message flow in the node permutation {1, 2, 3, 4, 5} gives the highest overall rate in this network. 
Figs. [6]-|9] show achievable rates, reception rates and power splits for nodes in different positions. We note that the 
nodes are arranged in a straight line. 

When the nodes are equally spaced, we see that the overall rate is constrained by R 2 and R 3 . Increasing the 
transmit power increases R 3 more than R 2 . So, to maximize min{i?2, -R3}, the optimal a 2 increases to increase R 2 
further. When the transmit power increases beyond 10W, a 2 reaches it maximum and the overall rate is now restricted 
by R 2 alone. To understand this, we look at the rate equations. For nodes 3-5, they decode the transmissions from 
2 1/2 nodes behind, but node 2 decodes only from node 1. This makes R 2 the bottleneck of the overall transmission 
rate. High R4 and i?5 suggests that the overall rate can be improved by readjusting the position of the nodes. 

One way to improve R 2 is to decrease d\ 2 . By doing this, we reduce the signal attenuation from node 1 to node 

2. This indeed increases the overall rate, as shown in Fig. [7] Here d\ 2 = 0.5m, while keeping the positions of nodes 

3, 4, and 5 unchanged. Now, we see that the overall rate is constrained by R 2 , R 3 ,R 4 , and i?5, i.e., no single bottle- 
neck. We have seen that the increase in transmit power increases the reception rates of different nodes by different 
amount. Hence when the transmit power increases, the a's adjust themselves to maximize mm{R 2 , R 3 , R 4 , R5}. 

Now, we study the cases when the relay nodes are clustered at the source or at the destination. Fig. [8] shows 
achievable rates when the relays are clustered at the source. In this arrangement, the overall rate is constrained by 
both R 2 and R% when the nodes transmit at low power, and by R5 alone when the nodes transmit at high power. 
That i?5 being the bottleneck should not come as a surprise as node 5 is positioned far away from the rest of the 
nodes. However, at high power, the constraint is at R 2 and not at R5. The reason is that node 2 receives strong 
interference from node 4, which is near. 

When the relays are clustered at the destination, we expect R 2 to constrain the overall rate. This is shown in 
Fig. |U The reception rate at node 2 is low as the signal from node 1 is severely attenuated due to the large d\ 2 
and high interference from nodes 4 and 5, which are close to node 2. 

It is noted that when the overall rate is constrained by R 2 , the power allocations affecting it, which are a± and 
a 3 should be set to zero. Setting a± = 0, we ensure that all power from node 1 carries new information to node 
2. Setting 03 = 0, we maximize the amount of interference that node 2 can cancel in its decoding. 
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with equal node spacing. 
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Fig. 8: Achievable rates of two-hop myopic decode- 
forward for the five-node multiple -relay channel, 
with the relays clustered at the source. 
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Fig. 7: Achievable rates of two-hop myopic decode- 
forward for the five-node multiple -relay channel, 
with node 2 closer to the source. 
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Fig. 9: Achievable rates of two-hop myopic decode- 
forward for the five-node multiple -relay channel, 
with the relays clustered at the destination. 



4) Omniscient Coding: In omniscient decode-forward, encoding is as follows. 

• Node 4 sends X 4 = y/P^Ui. 

. Node 3 sends X 3 = - a 3 )JW3 + ^/a ^U 4 . 

. Node 2 sends X 2 = V (l - a 2 - ffz")iW2 + VN^Us + Vc^U 4 . 

. Node 1 sends X x = ^{1 - a x - J x - 71)^1^1 + ^/WiU 2 + VA^Wa + y/aJ\U A . 
Here, Ui,i = 1,2,3,4 are independent Gaussian random variables with unit variances, < u\ + /3i + 71 < 1, 
< a 2 + 02 < 1, < 03 < 1, and «j, 71 > 0, i = 1, 2, 3, j = 1, 2. To illustrate the power splits, let us consider 
node l.,It allocates a\ of its total power to transmit to node 5, j3\ of its power to node 4, 71 of its power to node 
3, and the remaining power to node 2. 

Fixing some {a\, Pi, 71, a 2 , P2, 0:3}, the reception rate at node 2 is 

i? 2 = /(Xi ^p^XO (24a) 



1 



-log27re ^(l-ai-/3i-7i)Pi+iV2 --log27reAf 2 (24b) 



2 



1 
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J log [l + d^(l -ai-Px- 7i)Pi 



(24c) 



2 

Here, we have substituted k = 1, rj = 2, and A^2 = 1W. The reception rates at nodes 3, 4, and 5 can be computed 
in a similar way. Omniscient decode-forward achieves rates up to 

Pomnicient = , max min R t . (25) 

{a u p u i u a2,fa,OL 3 } *£{2,3,4,5} 

We define the following efficiency term to benchmark the performance of fc-hop myopic coding. 

Pk = ^±5_ (26) 

-^omniscient 

where fce{l,2,...,T — 1}. It is the ratio of the maximum achievable rate of a k-hop myopic coding strategy to 
that of the corresponding omniscient coding strategy. 

Figs. [TOl and [TT1 show achievable rates in the five-node and the six-node multiple -relay channel respectively, using 
one-hop, two-hop, and omniscient decode-forward. 

The maximum rate achievable by myopic coding can never exceed that by the corresponding omniscient coding. 
This is because under myopic coding, every node treats the transmissions of the nodes outside its view as noise. 
In addition, a node can only transmit limited messages. On the other hand, under omniscient coding, a node can 
decode the signals from all the nodes behind and cancel the transmissions of all the nodes in front. A node can 
also possibly transmit all previously decoded messages. 

In Fig. [TOl we see a seemingly strange result that the maximum achievable rate of two-hop myopic decode- 
forward is as high as that of omniscient decode-forward. This can happen in a five-node channel under certain 
circumstances. Using either omniscient or two-hop myopic decode-forward, node 3 in the five-node multiple -relay 
channel can communicate with all other nodes, i.e., it decodes from nodes 1 and 2, and cancels transmissions from 
node 4. So, when the overall transmission rates is constrained by R%, the maximum achievable rate of two-hop 
myopic decode-forward is the same as that of omniscient decode-forward. This explains why p2 = 1 at low SNR 
in Fig. M 

However, as the number of relays increases, we expect achievable rates of two-hop myopic decode-forward to 
be strictly less than that of omniscient decode-forward. We see that this is indeed the case from Fig. [TTJ in which 
P2 is strictly less than 1. 

Comparing achievable rates of one-hop and two-hop myopic decode-forward, the rates improve significantly 
when one more node is added into the nodes' view. This suggests that in a large network with many relays, fc-hop 
myopic decode-forward, where k needs not be large, could achieve rates close to that of omniscient decode-forward. 
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Furthermore, p\ and p 2 are high in the low SNR regime. The efficiency drops as the SNR increases. To understand 
this phenomenon, we consider different types of noise, i.e., receiver noise and interference. The nodes in both 
omniscient and myopic decode-forward experience the same receiver noise. So, in the low SNR regime where the 
receiver noise is dominant, myopic decode-forward performs close to omniscient decode-forward, and the efficiency 
is higher. On the other hand, in the high SNR regime, the interference (which a node cannot cancel in myopic 
decode-forward but can in omniscient decode-forward) is dominant. So, the efficiency of myopic decode-forward 
drops. 

F. Extending to k-Hop Myopic Coding 

Now, we generalize two-hop myopic decode-forward to A;-hop myopic decode-forward where k E {1, . . . ,T — 1} 
and have the following theorem. 
Theorem 3: Let 



be a T-node memoryless multiple -relay channel. Under fc-hop decode-forward, the rate R is achievable, where 



Here, U^^m) = 0, for all m = 2 — k, 3 — k, . . . , 0, T, T + 1, . . . , T + k — 1. The outer maximization is over all relay 
permutations and the inner maximization is taken over all joint distributions of the form 

p(xx,x 2 ■ ■ .,x T -i,u 1 ,u 2 ■ ■ .,u T -i,y2,V3 ■■■,Vt) 

= P(«7r(l)M U 7r(2)) • ■■V{u^(T-l)) 

x P(x 7 t(T-1)\u 7T (T-1))p(Xt T {T-2)\Ut T {T-2),U 7T ^ t _ 1 )) ■ ■ ■ i?(^(T-fe) \u%(T-k) ) ^7r(T-fc+l) • • • , u tt(T-1)) 
x P(. X Tr(T-k-l)\ u w(T-k-l)i u w(T-k) ■ ■ ■ ,^tt(T-2)) " ' * P( x tt(1) \ u tt(1)i u tv(2) , • • • , U Tr(k)) 

x P*{y2, ■ ■ -,yr\xi, ■ ■ -,X T -l). 
The proof can be found in Appendix |nl] In the extreme case where k = T — 1, we end up with omniscient 
decode-forward. 

G. On the Gaussian Multiple Relay Channel with Fading 

In the analyses so far, we compared the performance of myopic coding strategies in static Gaussian channels, 
i.e., without fading. Now, we explain how myopic coding is done in the Gaussian channel with phase fading or 
Rayleigh fading. 

It has been shown by Kramer et al. [18, Theorem 8] that under phase fading or Rayleigh fading, the maximum 
omniscient decode-forward rate can be achieved by independent Gaussian input distributions. In this case, Xi,i = 
1, . . . , T — 1, are independent Gaussian random variables. Under omniscient decode-forward, node t decodes from 
all nodes i,i < j, and cancels the transmissions of nodes /,/ > j. In /c-hop myopic decode-forward, the nodes 
transmit independent Gaussian signals as they would under the omniscient coding. However, in the decoding, node t 
decodes the signals only from k nodes behind, i.e., nodes i, i = max{l, t — k}, . . . , t— 1. It cancels the transmissions 
from only k nodes in front (including itself), i.e., nodes 1,1 = t, . . . , min{t + k — 1, T — 1}. It treats the rest of the 
transmissions as noise. The following theorem characterizes the performance of /c-hop myopic decode-forward for 
the Gaussian multiple-relay channel with phase fading or Rayleigh fading. 

Theorem 4: Consider a T-node Gaussian multiple -relay channel with phase fading or Rayleigh fading. Using 
k-hop decode-forward, the rate in equation (|27T ) is achievable, by setting Xi = Ui,X{ = Ui,\/i = 1, 2, . . . , T — 1. 

The proof for the above theorem is straight forward given that the nodes transmit independent signals in the 
fading channel. 




R < maxmax min I(U A t-k) , • • • , ^(t-i)! *^r(t) I • • • . ^(t+fc-i)) 



(27a) 




(27b) 
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Fig. 12: The power allocation of two-hop myopic decode-forward for the Gaussian multiple-relay channel. 



H. Myopic Coding in Large Multiple-Relay Channels 

One potential problem of myopic coding is whether the rate vanishes when the number of nodes in the network 
grows. This concern arises because in myopic decode-forward, a node treats transmissions of nodes beyond its 
view as pure noise. As the number of transmitting nodes grows to infinity and each decoding node only has a 
limited view, the noise power might sum to infinity. The noise might overpower the signal power and drive the 
transmission rate to zero. 

In this section, we scrutinize achievable rates of two-hop myopic decode-forward in the T-node multiple -relay 
channel when T grows to infinity. The rationale of studying two-hop myopic coding is that we can always achieve 
higher transmission rates using fc-hop myopic coding with k > 2. 

Theorem 5: Achievable rates of fc-hop myopic decode-forward in the T-node Gaussian multiple -relay channel 
are bounded away from zero, for any T > 3. 

Now, we prove Theorem [5] In two-hop myopic decode-forward for the T-node Gaussian multiple -relay channel 
(we shall extend T to infinity later), the transmission of each node is as follows. 



. Node t,t = 1,2,... ,T- 2, s ends X t = Ve^P t U t+1 + ^(1 - a t )P t U t . 

. Node T - 1 sends X T _i = y/T^U T -i. 
where Ui, i = 1, 2, . . . , T — 1, are independent Gaussian random variables with unit variances and < on < 1. The 
transmissions of the nodes around node t are depicted in Fig. [[2] 

Assume that all the nodes are equally spaced at lm apart and transmit at power P. Consider the received signal 
power at node t, we can always find a non-empty set {(«i, . . . , ax-2) ■ < aii < 1, i = 1, . . . , T — 2} such that 

P sig (t) = (j/3-Va t - 3 KP + ^2-»(l -a t _ 2 )Kp) + (^2^a t ^ 2 KP + ^1^(1 - at_i)«p) (29a) 
'3-Vat^KP + ^2-^(1 - a t - 2 ) K p) + (j2^a t ^P + J 1^(1 - a^KP) (29b) 



>0, 



for t > 4, and 



P sig (2) = (1 - ax)KP > 



P sig (3) = 2"' 7 (1 - a^nP + \^j2^ aiK p + ^1~»J(1 - a 2 )KPJ > 0. 
Now we consider nodes 4 < t < T — 3, the noise power is T n oise(*) = N t < oo, and the interference power is 



(29c) 

(30a) 
(30b) 
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given by 



+ [J(t - 2)-"(l - a 2 )nP + J(t - l)-Va lK P + (t - 1) _7? (1 - «i)«P 



+ (y/(T - t - 3)-ia T -3KP + ^(T-t- 2)^(1-0^2)^ 2 



+ ^ v /(T-t-2)-^a T _2«i :> +v / ( T - t - 1 )^ KP ) . ( 31a ) 
3-"at_ 3 + 4-" + 5-" + ••• + (*-!)-" 



+ 2^3-U-v(l - at- 3 )a t -4 + 2y]4rvh-i(\ - a t - 4 )a t - 5 + ■■■ + 2y] (t - 2)~^{t - 1)-»?(1 - a 2 )«i 
+ l- r '«f +1 + 2-" + 3"" + • • • + (T - t - 



+ 2 x /l-'?2-^a t+1 (l - a t+2 ) + 2,/2-'?3-^ t+2 (l - a t+3 ) + • • • 



+ 2^/(T - t - 3)"»?(r - t - 2)-'Ja T _ 3 (l - a T _ 2 ). (32a) 
Simplifying, we get 



(33a) 

t-l i T-t-l t-2 T-i-3 1 

*^ ^— < ^r; ^— < jrj 2 ^— < «»7 2 ^— < (33b) 

j=3 j=l J j=3 j=l •* 

T 1 

<6^-<6C(r?). (33c) 

Here C(v) = is tne Riemann zeta function. It has been calculated that C(2) = ^, C(3) = 1.202057... etc. 

It is easily seen that the Riemann zeta function is a decreasing function of r\. Since, rj > 2, Pi n t(i) < tt 2 kP for 
4 < t < T - 3. We can also show that P int (t) / (kP) for t = 2, 3, T - 2, T - 1, T are bounded. Hence, we can 
always find a non-empty set {(ai, . . . , cht-2)} sucn that the reception rate at every node t, Vt G {2, 3, . . . , T}, is 

Psig(i) 



Pt = ^log 



1 + 



> 0, (34) 



Pint(i) + N t 

which is bounded away from zero. This means the maximum achievable rate 

P2-hop = max min R t > (35) 

{ai,...,Q T -2}te{2,3,...,T} 

is bounded away from zero. 

When more nodes are included in the view of myopic coding, P s ; g increases and P nt decreases. In general, 
assuming that the nodes are roughly equally spaced, achievable rates of myopic decode-forward are bounded away 
from zero even when the network size grows to infinity. 

In the next two sections, we study achievable rates of myopic and omniscient coding strategies for the multiple- 
access relay channel and the broadcast relay channel. 
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Fig. 13: Omniscient decode-forward for the four-node Fig. 14: One-hop myopic decode-forward for the four- 
multiple-access relay channel. node multiple-access relay channel. 

IV. Myopic Coding in the Multiple-Access Relay Channel 

A. Channel Model 

The multiple-access relay channel has multiple sources, one relay, and one destination. In the T-node multiple- 
access relay channel, nodes 1 to T — 2 are the sources, node T — 1 is the relay, and node T is the destination. 
The rates (R±, . . . , Rt-2) for nodes 1, . . . , T — 2 respectively are said to be achievable if each node can transmit 
messages to the destination at their respective rates with diminishing error probability. They follow closely the 
definition that we adopt for the multiple -relay channel. The sources do not receive feedback from the channel. The 
multiple-access relay channel can be completely described by its channel distribution of the following form. 

P*(yT-i,yT\xi,...,x T -i). (36) 

B. Achievable Rates 

In this paper, we consider the four-node multiple-access relay channel, where nodes 1 and 2 are the sources, 
node 3 is the relay, and node 4 is the destination. We assume that data from node 1 and node 2 are independent. 
We investigate decode-forward based coding strategies for the multiple-access relay channel, in which the relay 
must decode all messages from both sources. 

1 ) Omniscient Coding: In omniscient decode-forward for the four-node multiple-access relay channel, nodes 1 
and 2 transmit to both nodes 3 and 4. This is depicted in Fig. [13] Using offset encoding [14] and sliding window 
decoding, omniscient decode-forward achieves the following rate region [18]. 

Rx < I(X 1 ;Y 3 \U 1 ,U 2 ,X 2 ,X 3 ) 

R 1 <I(X 1 ,X 3 ;Y 4 \U 2 ,X 2 ) 

R 2 <I(X 2 ;Y 3 \U 1 ,U 2 ,X 1 ,X 3 ) 

R 2 <I(X 2 ,X 3 ,Y 4 \U 1 ,X 1 ) 
Ri+R 2 <I(X 1 ,X 2 ;Y 3 \U 1 ,U 2 ,X 3 ) 
Ri + R 2 <I(X l ,X 2 ,X 3 ;Y A ), 

where the mutual information terms are taken over 

p(u 1 ,u 2 ,x 1 ,x 2 ,x 3 ,y 3 ,y 4 ) = p(ui, xi)p(u 2 , x 2 )p(x 3 \u 1 , u 2 )p*(y 3 , y^xi, x 2 , x 3 ). (38) 

We note that in this four-node multiple-access relay channel, two-hop myopic decode-forward is equivalent to 
omniscient decode-forward. 

2) One-Hop Myopic Coding: In one-hop myopic decode-forward for the four-node multiple-access relay channel, 
nodes 1 and 2 transmit to node 3, but not to node 4. In this scenario, we have the channel model as depicted in 
Fig. dU We can view this as a multiple-access channel (from nodes 1-2 to node 3) cascaded with a point-to-point 
channel (from node 3 to node 4). Modifying the results of the multiple-access channel in [33], the following rate 



(37a) 
(37b) 
(37c) 
(37d) 
(37e) 
(37f) 
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region is achievable by one-hop myopic decode-forward. 

#!< J(Xi;Y 3 |X 2 ,X 3 ) (39a) 
R 2 <I(X 2 ;Y 3 \X 1 ,X 3 ) (39b) 
R l + R 2 <I{X 1 ,X 2 ;Y 3 \X 3 ) (39c) 
P1 + P2 <I(X 3 ;Y 4 ), (39d) 
where the mutual information terms are derived under the joint distributions p(xi,x 2 ,x 3 ,y 3 , j/4) = p(xi)p(a; 2 )p(:r 3 ) 

p*(y3,y4ki,x 2 ,x 3 ). 

C. Performance Comparison 

1) Channel Setup: Now, we investigate achievable rates of one-hop myopic decode-forward and omniscient 
decode-forward for the four-node Gaussian multiple-access relay channel. Nodes 1, 2, and 3 send X\, X 2 , and X 3 
respectively. Node 3 receives 



y 3 = V * d n x i + v Kd ^ x ^ + z 3 (40) 

and node 4 receives 



I4 = *1 + V Kd 24 ' X 2 + V Kd 34 ^3 + Z 4 (41) 

where Z 3 and Z A axe independent zero-mean white Gaussian noise with variances N 3 and N4 respectively. X\, X 2 , 
and X 3 are zero-mean Gaussian random variables with fixed average transmit power i£[.Xjp] = Pi, i = 1,2,3. In 
our analysis, we use the following parameters. di 2 = d 23 = d\ 3 = lm, N 3 = iV 4 = 1W, k = 1, r\ = 2, d\ 3 = d 23 , 
and du = d 2A . We let R 3 be the reception rate (sum rate) at node 3, and P 4 the reception rate (sum rate) at node 
4. 

2) One-Hop Myopic Coding: From (I39cb . the reception rate (sum rate) at node 3 is 

R' 3 = X - log 27reE[Y 3 2 } - I log 27reP[Z 3 2 ] (42a) 
= i log 2vre (kc^Pi + «^P 2 + N 3 ) - i log 2^eiV 3 (42b) 

= ilog(l + P 1 + P 2 ). (42c) 

Here, we have substituted k = 1, d\ 3 = d 23 = lm, rj = 2, and iV 3 = 1W. From d39d| ), the reception rate at node 4 
is 

P 4 = - log 2vre (nd^Pi + Kd^P 2 + nd^P 3 + iV 4 ) - - log 27re (/wi^Pi + Kd^-Ffe + JV 4 ) (43a) 

P3/d 34 \ (43b) 

where (I43bb is obtained after substituting k = 1, 77 = 2, iV 4 = 1W, and d\ 4 = d\ A = + d 34 j + \. 
Since each message must be completely decoded by nodes 3 and 4, the following rates are achievable 

R' = Ri + R 2 < min{P4 P 4 } = Pi_ hop . (44) 

Fig. Q3] shows how the maximum achievable sum rate Pi_h op varies with d 3A when Pi = P 2 = P 3 = 10W. When 
the destination is near the relay, R' A is higher than R' 3 , which is a constant at I(X\X 2 ; Y" 3 |X 3 ) = 2.196 bits/channel 
use. Hence, Pi-hop is constrained by R' 3 . When <i 34 increases, Pi_h op is constrained by P 4 , which decreases as d 34 
increases. 

Intuitively, when the rate is constrained by P 4 , nodes 1 and 2 can reduce their transmit power to reduce the 
interference from nodes 1 and 2 at node 4. Fig. [16] shows achievable rates when we vary Pi = P 2 while keeping 
d 3 4 and P 3 constant. When Pi = P 2 < 2.196W, Pi_h op is constrained by P3. Increasing Pi and P 2 increases Pi_h op - 
However, when Pi and P 2 are large, the interference at node 4 increases and Pi_h op is now constrained by P 4 . In 
this case, increasing Pi and P 2 decreases Pi_h op - We see that there is an optimal point P\ = P 2 = 2.196W for 
which Pi_h op is maximized for fixed <i 34 and P 3 . 
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k=1,ti=2, N=1W, P 1= P 2 =P 3 =10W 
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Fig. 15: Achievable sum rates of one-hop myopic 
decode-forward and omniscient decode-forward for the 
four-node multiple-access relay channel. 
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Fig. 16: Achievable sum rates of one-hop myopic 
decode-forward for the four-node multiple-access relay 
channel. 



3) Omniscient Coding: In omniscient decode-forward, nodes 1, 2 and 3 transmit the following [16]. 

Xt = /fM^SIC/i + Vl^cViVi) (45a) 
X 2 = V^{V^U 2 + VT^c7 2 V 2 ) (45b) 
^3 = v^CVA^i + V%U 2 ) (45c) 

where and 14, k = 1,2, are independent, zero-mean Gaussian random variables with unit variance, < a\, a 2 < 

1, Pi, fa > 0, and Pi + fc = 1. 
From (I37eb . the reception rate (sum rate) at node 3 is 



R' 3 = H(Y 3 \U!,U 2 ,X 3 ) - H{Y 3 \U X ,U 2 ,X X ,X 2 ,X 3 ) 

= ±]og2ire[PiKd$(l - ai )+P 2 Kd^{l - a 2 )+N 3 ] - Il og 2^eiV 3 



1 



log[l + Pi(l-ai)+P 2 (l-a 2 )]. 



Here, (I46cb is obtained by substituting k = 1, d\ 3 = d 23 = lm, N 3 = 1W. 
From d37f| ), the reception rate at node 4 is 



R!± = H{Y i )- H{Y 4 \X 1 ,X 2 ,X 3 
1 



log 27re 



1 



5" + J- + 5" + 2A: v /PiP 3 (di4d34)-"ai/3i + 2kJp 2 P 3 (d 2A d u )^a 2 (3 2 + 7V 4 

"14 "24 "34 



+ - log 2<7reiV4 



— log 

2 & 



1 i\ 1% i% 2Vai/jiPiP 3 2Va 2 ^ 2 P 2 P 3 

-L "i ,o — r ,o "T" ,n "T" , , i 



if 1 



d 2 

"34 



^14^34 



Here, we have substituted n = 1, rj = 2, A r 4 = 1W. d 14 — u, 24 



14 "24 

2 _ j2 
14 — ": 

The following rates are achievable 

R' = R 1 + R 2 < min{P 3 , P 4 } = R 
for some < a\, a 2 < 1 and (3i + (3 2 = 1. 



d 2 4G? 3 4 



(^ + d 34 ") 2 + i. 



P 



2-hop ) 



(46a) 
(46b) 

(46c) 

(47a) 

(47b) 
(47c) 



(48) 



20 



k=1,ti=2, N=1W, d^lm 
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Fig. 17: E! vs. P±,P2 and P3 for one-hop myopic 
decode-forward for the four-node multiple-access relay 
channel. 
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Fig. 18: Comparison of achievable sum rates of one-hop 
myopic decode-forward and omniscient decode-forward 
for the four-node multiple-access relay channel. 



To compare achievable rates of one-hop myopic decode-forward with that of omniscient decode-forward, we 
have calculated R' for Pi = P2 = P3 = 10W. Because of symmetry, we set a\ = ot2 and (3\ = P2 = \- 

Fig. Q3] shows achievable rates for varying and ot\ (= 02)- We see that when ^34 is small, i.e., the destination 
is close to the relay, the optimal a\ is 0. This is intuitive because as d^i is small, the overall rate is constrained by 
i? 3 . The relay-to-destination link is almost noise free. The reception rate at node 3, R' 3 , is maximized at ol\ = 
when nodes 1 and 2 allocate all signal power for new information (rather than helping the relay to transmit old 
information). 

When c?34 is small, the maximum achievable sum rate of one-hop myopic decode-forward is the same as that of 
omniscient decode-forward. As the constraint is on R' 3 , whether node 4 decodes additional signals from nodes 1 
and 2 does not have any effect on the overall achievable rate. However, as 1^34 increases, the rate constraint shifts to 
R' A . R' 4 of one-hop myopic decode-forward is lower than that of omniscient decode-forward because node 4 does 
not decode transmissions from nodes 1 and 2 in the former. 

Also, when the maximum achievable sum rate is constrained by R' 4 , the rate can be increased with a larger a\. 
This is because a\ controls the portion of power for direct transmission from nodes 1 and 2 to node 4. Using a 
higher ol\, the rate on the constrained link (1, 2, 3) — > 4 improves and so does the overall rate. When the relay is 
close to the destination, a smaller ot\ is preferred. When the relay is far away from the destination, higher achievable 
rates are possible using a larger a\. We note that no matter how far the relay is from the destination, the optimal a± 
is always strictly less than 1. Setting a± = 1 means the source does not send new information and merely repeats 
what the relay sends and hence new information is never transmitted. 

Figures [T7] and [18] depict achievable sum rates of one-hop myopic decode-forward and omniscient decode-forward 
(with a± = ct2 = in the omniscient coding) for different transmission power. ^34 is set to lm. It is noted that for 
small c?34, the optimal a\ and 02 are 0. So, we set a\ = 02 = for the omniscient coding strategy. 

In Fig. [T7J we see that increasing P3 always increases achievable rates of both myopic decode-forward and 
omniscient decode-forward. This is because transmissions from node 3 are never treated as noise. However, in one- 
hop myopic decode-forward, increasing Pi and P2 decreases R' 4 and R', as node 4 treats these transmissions as 
noise. On the other hand, increasing the transmit power at any node always increases achievable rates in omniscient 
decode-forward, as all transmissions are either canceled off or decoded. 

From Fig. [TU we see that when the sources transmit at low power and the relay transmits at high power, achievable 
sum rates of one-hop myopic decode-forward are as high as that of omniscient decode-forward. The reason for this 
is similar to that explain in Section ITlI-E.41 When the source-relay link is the bottleneck of the overall transmission, 
achievable rates of myopic decode-forward are the same as that of the corresponding omniscient decode-forward. 
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Fig. 19: Omniscient decode-forward for the four-node 
broadcast relay channel. 



Fig. 20: One-hop myopic decode-forward for the four- 
node broadcast relay channel. 



V. Myopic Coding in the Broadcast Relay Channel 

A. Channel Model 

The broadcast relay channel has one source, one relay, and multiple destinations. In a T-node broadcast relay 
channel, nodes 1 is the source (which does not receive feedback from the channel), node 2 the relay, and nodes 

3 T the destinations. The common rate Rq (information that is common to all destinations) and the private 

rates (R 3 , . . . , Rt) for nodes 3, . . . , T respectively are said to be achievable if the source can transmit information 
to the destinations at these rates with diminishing error probability. 

The broadcast relay channel can be completely described by its channel distribution of the following form. 

V*{V2,---,yT\xi,x 2 ). (49) 

B. Achievable Rates 

In this paper, we consider the four-node broadcast relay channel, where nodes 1 is the source, node 2 is the 
relay, and nodes 3 and 4 are the destinations. Node 1 is connected to a message generator that generates messages 
W 3 and W 4 to be sent to nodes 3 and 4 respectively; and common message Wo to be sent to both destinations. 
We assume that W 3 and W4 are independent. Again, we use decode-forward-based coding strategies, in which the 
relay fully decodes all messages from the source. 

1 ) Omniscient Coding: In omniscient decode-forward for the four-node broadcast relay channel, node 1 transmits 
to nodes 2, 3, and 4, while node 2 transmits to nodes 3 and 4. This is depicted in Fig. [19j Kramer et. at [17] 
gives achievable rates for the case where there are independent individual messages for nodes 3 and 4 as well as 
common messages for both receivers. In this paper, we consider the case where there is no private message. Under 
this condition, the following common rates [17, eq. (28)] are achievable by omniscient decode-forward. 

R < min[/(X i; Y 2 \X 2 ), I(X 1 ,X 2 ; Y 3 ),I(X U X 2 ; Y 4 )] = R omniscient . (50) 

Similar to the multiple-access relay channel, omniscient decode-forward is equivalent to two-hop decode-forward 
for the four-node broadcast relay channel. 

2) One-Hop Myopic Coding: In one-hop myopic decode-forward for the four-node broadcast channel, node 1 
transmits to only node 2, and node 2 transmits to nodes 3 and 4. This is depicted in Fig. |20l This is equivalent to 
a single point-to-point channel cascaded with a broadcast channel. The following rates are achievable by one-hop 



myopic decode-forward. 

R < min[/([/ ; y 3 ), I(U ; Y 4 )] (51a) 

Ro + Ri< I{U ; Y 3 ) + J(*7 3 ; Y 3 \U ) = I(U , U 3 - Y 3 ) (51b) 

Ro + Ri < I(U ; Y 4 ) + I(U 4 ; Y 4 \U ) = I(U , U 4 ; Y 4 ) (51c) 

R + R 3 + i? 4 < min[7(C/ ; Y 3 ), I(U ; Y 4 )] + Y 3 \U ) + I(U A - Y 4 \U ) - I(U 3 ; U 4 \U ) (5 Id) 

R Q + R 3 + R 4 <I(X l ;Y 2 \X 2 ), (51e) 



for some p(uo, u 3 , u 4 , x\, x 2 ) = p(xi)p(uo,u 3 , u 4 ,x 2 ). The rates are be obtained by cascading a point-to-point 
channel (from node 1 to node 2) to a broadcast channel (from node 2 to nodes 3 and 4). Equation (15 leb gives the 
rate constraints on the point-to-point channel; (I51al) - (l51dl ) gives the rate constraints on the broadcast channel with 
common information [34, p. 391]. Here, Uq carries information to be decoded by both nodes 3 and 4. U 3 and U4 
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carry private information to nodes 3 and 4 respectively. We set private messages to zero, that is R 3 = R4 = 0. We 
choose Uq = X 2 , U 3 = U4 = 0. Hence, the rate at which common messages can be sent to both receivers is 

R < min[I(X r ,Y 2 \X 2 ),I(X 2 ;Y 3 ),I(X 2 ;Y 4 )} = R uhop . (52) 

We see that (l52l differs from (f50b in the last two terms. In the former, there is no cooperation between node 1 
and node 2. In the latter, cooperation under the omniscient coding is reflected in the term (X\, X 2 ). 



C. Performance Comparison 

1) Channel Setup: We compare achievable rates of one-hop myopic decode-forward and omniscient decode- 
forward for the four-node Gaussian broadcast relay channel. Nodes 2, 3, and 4 receive the following signal 
respectively. 



Y 2 
Y 3 



Kd 12 v X 1 + Z 2 



nd,nXi + J Kd 2 n'X 2 + Z; 



ndiPXi + V nd 2 PX 2 + Z 4 



(53a) 

(53b) 

(53c) 
(53d) 



where -E7[-X^] = P\, E^-Xf] = P 2 , and Z 2 , Z 3 , and Z4 are white Gaussian noise with variances N 2 , N 3 , and N4 
respectively. In the analysis in this section, we use the following parameters: ^23 = d 24 = d 34 = lm, di 3 = du, 
N 2 = N 3 = N 4 = 1W, k = 1, and 77 = 2. 

2) One-Hop Myopic Coding: In one-hop myopic decode-forward, the reception rate at node 2 is 



R'n 



^ log 2Tre[Kd l2 n P l + N 2 ] - - log 27reN 2 



1 + £ 
"12 



Due to symmetry, the reception rates at both node 3 and node 4 are 

#3 = R'a = j lo § ^e[ K d 23 v P 2 + Kd^Pi + N 3 ] - - log 2ne[Kd^Pi + N 3 ] 



1 



log 



- log 

2 6 



1 + 
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P 2 /d 
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I + P1M3 
P2 



1 + 



Pi 



l/4+(V3/2+d 12 ) 2 



Hence, achievable common rates are up to 

R < min{i?2,-R 3 ,-R 4 } 



1 

- log 

2 & 



1 + mnW - pr , 



P7 



4 2 '1 



+ 



Pi 

l/4+(v / 3/2+di 2 ) 2 



R 



l-hop- 



(54a) 
(54b) 

(55a) 
(55b) 

(55c) 

(56a) 
(56b) 
(56c) 



3) Omniscient coding: In the case where only common messages are to be sent, the channel can be simplified 
to two identical relay channels due to symmetry. Similar to the relay channel, nodes 1 and 2 transmit the following 
respectively. 

Xi = y/K(y/aU 2 + VT^Ut) (57a) 
X 2 = ^P~ 2 U 2 (57b) 

where U 2 and U\ are independent zero-mean Gaussian random variables with unit variance. 
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Fig. 21: i?o vs - for one-hop myopic decode-forward 
and omniscient decode-forward for the four-node broad- 
cast relay channel. 
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Fig. 22: Comparison of achievable sum rates of one-hop 
myopic decode-forward and omniscient decode-forward 
for the four-node broadcast relay channel. 



The reception rate at node 2 is 



b! 2 = i{x 1 -y 2 \x 2 ) 

= - log 2Tre[Kd^aP 1 + N 2 ] 
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log 2ireN 3 



log 
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and the reception rate at node 3 (and node 4 due to symmetry) is 



ti 3 = & A = I(X 1 ,X 2 ;Y 3 ) 



1 



log 2ire 



Kd^(l - a) Pi + (^Kd'^aP! + 



nd 2 £P 2 



+ N 3 
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log 27reiV3 



log 
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Hence, achievable common rates are up to 

Rq < min{i?2, R4} 



1 / (1 - a)P l Pi laPxPo 

_ log 1 + mm HM,_± + ft + 2 /_i_l 
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(58a) 
(58b) 

(58c) 

(59a) 
(59b) 

(59c) 

(60a) 
(60b) 
(60c) 



for some < a < 1, where df 3 = 1/4 + (\/3/2 + (ii 2 ) 2 . 

In Fig. |2T] the maximum achievable common rate is constrained by R 3 (and R'£) when di2 is small, and by i?' 2 
when d\ 2 gets large. From the rate expressions, we see that R' 2 of the myopic coding and the omniscient coding has 
the same expression (by setting a = in the latter). When the maximum achievable common rate is constrained by 
R' 2 , the optimal a is 0, to make the first term in (l60l largest possible. When d\ 2 is large, R' 2 is the bottleneck, and 
achievable rates under both coding strategies are the same. This is because using either the myopic coding or the 
omniscient coding, node 2 only decodes from node 1. Comparing the transmit power of 1W and 10W, when nodes 
transmit at lower power (or lower SNR) R 2 constrains the overall rate for a larger range of d\ 2 . So, achievable 
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rates of one-hop myopic decode-forward are as high as that of omniscient decode-forward for larger range of di2 
in the low SNR regime. 

Fig. [22] depicts achievable rates of one-hop myopic decode-forward and that of omniscient decode-forward for 
different Pi and P%. Achievable rates of the myopic coding are as high as that of the omniscient coding when Pi 
is low and P2 is high. This is exactly the criteria for Rq to be constrained by R' 2 , or in other words, when the 
source-relay link is the bottleneck. 

VI. Conclusion 

We derived achievable rates of myopic decode-forward coding strategies for the multiple-relay channel, the 
multiple-access relay channel, and the broadcast relay channel. Myopic coding has practical advantages of being 
more robust to network topology changes, less processing, and fewer storage requirements at each node. 

We showed that in the low SNR regime, achievable rates of two-hop myopic decode-forward are as large as that 
of omniscient decode-forward in a five-node multiple -relay channel, and close to that of the omniscient coding in 
a six-node channel. Comparing one-hop myopic decode-forward and two-hop myopic decode-forward, we see that 
adding a node into the nodes' view improves the achievable rate significantly. Hence, besides being more practical, 
a myopic coding strategy potentially (as only non-constructive coding is being considered) performs as good or 
close to the corresponding omniscient coding strategy. This means in a large network, we might do local coding 
design without compromising much on the achievable rate. 

We also analyzed two myopic coding strategies in the multiple-access relay channel and the broadcast relay 
channel. Using examples of four-node Gaussian channels, we showed that achievable rates of these myopic coding 
strategies are as good as that of their corresponding omniscient coding strategies when the source(s) transmit(s) at 
low power and the relay transmits at high power. 

The analysis in this paper helps us to understand coding in multi-terminal networks better. This work sheds light 
on the practical design of efficient transmission protocols in wireless networks, where robustness, computational 
power, and storage memory are important design considerations, in addition to transmission rate. 

Appendix I 

An Example to Show that Myopic Coding is More Robust 

To illustrate the robustness of myopic coding, we consider decode-forward in the seven-node Gaussian multiple- 
relay network in which node 4 fails. This means the signal contributed by node 4 will stop. We consider the 
following scenarios in myopic and omniscient coding: 

i) Two-hop myopic decode-forward: 

a) When the overall transmission rate is not affected: Node 2 decodes only from node 1, and cancels the 
interference only from itself (echo cancellation) and node 3. So, the failure of node 4 does not affect the 
decoding at node 2. Node 7 will also not be affected as it decodes only from nodes 5 and 6. In brief, the 
failure of node t only affects nodes t — 1, t + 1, and t + 2 in two-hop myopic decode-forward. 

b) When the overall transmission rate is affected: Suppose that upon node 4's failure, the overall transmission 
rate is lowered due to the change in the reception rate of node 5. Additional re-configuration at the source 
is required. Now, the source will have to transmit at a lower rate. One way of doing this is to use the 
existing code, but pad the lower rate messages with zeros. With zero-padding, the encoding and decoding 
at nodes 2 and 7 need not be changed as the supported rates at these nodes are not affected. 

ii) Omniscient decode-forward: Nodes 2 and 3, who presume that node 4 is still transmitting and attempt to 
cancel its transmissions, will introduce more noise to their decoders. Nodes 5 to 7, who use node 4's signal 
contribution in the decoding, will experience a lower SNR. Hence the supported rates at these nodes will be 
lowered. 

Using omniscient coding, any topology change in the network (e.g., node failure or relocation) requires re- 
configuration of more nodes compared to using myopic coding. 
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Fig. 23: The encoding scheme of two-hop myopic decode-forward for the multiple-relay channel. 

Appendix II 
Proof of Theorem [2] 

In this appendix, we describe the encoding and decoding schemes, and prove achievable rates of two-hop myopic 
decode-forward for the multiple-relay channel. We consider B + T — 2 transmission blocks, each of n uses of the 
channel. A sequence of independent B indices, Wb G {1, 2, . . . , 2 nR }, b = 1, 2, . . . , B are sent over n(B + T — 2) 
uses of the channel. As B — > oo, the rate RnB/n(B + T — 2) — ► i? for any n. 

Note: We use w and 2 to represent the source message. The notation Wj denotes the information which the source 
outputs at the j-th block. This means the source emits w\, w 2 , ... in blocks 1, 2, . . . respectively. The notation zt 
denotes the new information which node t transmits. Since each node transmits codewords derived from the last 
two decoded messages, node 2 always transmits (z2,Zs). These different notations are used at different instances 
for better illustration. 

A. Codebook Generation 

In this section, we see how the codebook at each node is generated. 

• First, fix the probability distribution 

P(UI,U 2 , ■ ■ . ,U T ~l,X 1 ,X 2 , ■ ■ ■ ,X T -l) = p{ui)p(u 2 ) ■ ■ ■ p{uT-l)p(x 1 \u 1 ,U2)p{x 2 \u2,U 3 ) ■ • • p{x T -l \ «T-l) 

for each Ui EUi. 

• For each t G {1, . . . , T — 1}, generate 2 nR independent and identically distributed (i.i.d.) ?i-sequences in 14™, 
each drawn according to p(ut) = rii=i p{ u u)- Index them as u t (z t ), zt G {1, • • • , 2 nR }. 

• Define xt-i(zt-i) = ut-i(^t-i). 

• For each t € {1, . . . , T — 2}, define a deterministic function that maps (u t , u t+ i) to x t : 

x t (z t ,z t+1 ) = ft(ut(zt),u t +i(zt+i)). (61) 

• Repeat the above steps to generate a new independent codebook [12]. These two codebooks are used in alternate 
block of transmission. The reason for using two independent codebooks will be clear in the error probability 
analysis section. 

We see that in each transmission block, node t, t G {1, . . . , T — 2}, sends messages of two blocks: z% (new data) 
and Zt+i (old data). In the same block, node t + 1 sends messages Zt+i and zt+2- Note that a node cooperates with 
the node in the next hop by repeating the transmission Zt+i. We will see this clearer in the next section. 

B. Encoding 

Fig. |23] shows the encoding process for two-hop myopic decode-forward. The encoding steps are as follows: 

• In the beginning of block 1, the source emits the first source letter w\. Note that there is no new information 
after B blocks. We define wb+i = wb+2 = • • • = wb+t-2 = 1. 

• In block 1, node 1 transmits xi(it?i, wq). Since the rest of the nodes have not received any information, 
they send dummy symbols Xi(w2-i,wi-i), i G {2, ... ,T — 1}. We define Wb = 1, for b < 0. In block 1, 

Zl = W 1 ,Z 2 = WQ,... 
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• At the end of block 1, assume that node 2 correctly decodes the first signal w\. 

• In block 2, node 2 transmits x.2(wi,wq). Node 1 transmits xi (w2,Wi). It helps node 2 to re-transmit w\ and 
sends W2 (new information) at the same time. In block 2, z\ = u>2, z% = wi, z% = wq, . . . 

• Generalizing, in block b G {1, . . . , B + T — 2}, node t, t G {1, . . . ,T — 1}, has data (w\, u>2, • • • , ^ft-t+i)- 
Under two-hop myopic decode-forward, it sends ~x.t{wb-t+i, Wf,_ t ). 

• We see that a node sends messages that it has decoded in the past two blocks. This adheres to the constraints 
of two-hop myopic decode-forward. 

C. Decoding 

• Under the two-hop myopic decode-forward constraints, a node can store a decoded message no longer than 
two blocks and can use two blocks of received signal to decode one message. 

• Node 2's decoding is slightly different from the other nodes as it has only one upstream node. So it decodes 
every message using one block of received signal. We illustrate the decoding of message at node 2. At the 
end of block 4, assuming that node 2 has already decoded messages (wi,W2,w-i) correctly. However, due to 
the myopic coding constraint, it only has W2 and W3 in its memory. This is because w\ was decoded at the 
end of block 1 and would have to be discarded at the end of block 3. So, it finds the a unique Ui(w4) which is 
jointly typical with u^(w2), l^^s), and y2,4 (the received signal at node 2 in block 4). We write y2 t 4 instead 
of y24 to avoid the confusion with the received signal of node 24. An error is declared is there if no such 

or more than one unique W4. 

• Nodes 3 to T decode a message using two blocks of received signal. Consider node 3. At the end of block 
4, assuming that node 3 has already decoded w\ (decoded at the end of block 2) and W2 (decoded at the end 
of block 3) correctly. Assume that it now correctly decodes using signals from blocks 3 and 4. At the end 
of block 4, it finds a set of ui(u;4) which is jointly typical with U4(wi), \iz(w2), 112(^3), and yz,A- We call 
this set C\(w±)- Since it can only keeps messages decoded over two blocks, it keeps W2 and ^3 and discard 
w\. At the end of block 5, node 3 finds a set of ^(u^) that is jointly typical with 114(^2), U3(w3), and y%£. 
We call this set £2(^4)- It finds a unique w± that belong to both sets, that is W4 G £1(^4) D £2(^4)- Here 
n denotes intersection of sets. An error is declared when the intersection contains more than one index or the 
sets do not intersect. 

• We now generalize the decoding process. Refer to Fig. |24l at the end of block 6—1, assuming that node 
t has correctly decoded (w±,... ,Wb~t)- Under the myopic coding constraint, it has in its memory Wb-t-i 
and Wb~t- It decodes Wb-t+i- It then finds a set of \i t -2{wb-t+2) that is jointly typical with (u t -i(wb-t+i), 
Ut(wb-t),u t +i(wb-t-i),yt(b~i))- Label this set C\{wb~t+2)- It discards Wb~t~i from its memory. At the end 
of block b, it finds the set of u t ~i(wb-t+2) that is jointly typical with (u t (wb-t+i) , Ut+i(u>6_t), ytb)- Label 
this set £2<Vb-t+2)- It declare Wb-t+2 if there is one and only one index in C\{wb-t+2) H £2(^?>-t+2)- 

D. Achievable Rates and Probability of Error Analysis 

In the previous section, we said that node t decodes message Wb-t+2 m block b. We denote the event that no 
decoding error is made at all nodes in the first b block, \ <b<B + T — 2, by 

C{b) 4 {w t {k-t+2) = w k -t+2 : Vt G [2, T] and k G [1, b}} (62) 

where w t ^) i s node t's estimate of the message Wb- This means in the first b blocks, node 2 will have correctly 
decoded (wi,W2, . . . node 3 will have correctly decoded (wo,wi, . . . ,Wb-i), and so on. We set = 1 for 
k < 0. They are the dummy signals sent by the nodes. 

We denote the probability that there is no decoding error up to block b as 

P c (b) 4 Pr{C(b)} (63) 

and -P c (0) = 1. The probability that one or more error occurs during block b G [1,-B + T — 2] at some node 
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In block (6-1) 



In block b 




S :Known to node t 



Fig. 24: Decoding at node t of message Wb-t+2- 



t G [2, T], given that there is no error in decoding at all nodes in all blocks up to b — 1, is 

P e (b) 4 p r {w t(b _ t+2) + w b - t+2 : for some t G {2, . . . , T}|c(6 - 1)} 

T 

< ^ Pr {^(b-t+2) / ^fc-t+2|C(6- 1)} 



i=2 
T 



t=2 



(64a) 
(64b) 



where P e t(b) = Pr ju^(&_ t+2 ) 7^ w?,_( + 2|C(6 — 1) j, which is the probability that node t wrongly decodes the latest 
letter w b _ t+ 2 in block b, given that it has correctly decoded the past letters. 

Now, we need to compute the error probability P e t(b). As mentioned in the decoding section, the decoding of a 
message spans over two blocks. For example, let us look at the decoding of message Wb-t+2 at node t, as depicted 
in Fig. |24l The message to be decoded is boxed and the messages that node t has correctly decoded are marked 
with /. In block 6—1, node t find a set of w b ^ t +2 f° r which 

^u t ^ 2 (wb~t+2),^i{m~t+i),ut(w b ^ t ),u t+1 (w b ^i),yt(b~i)) G ■K. (Ut-2,Ut-i,U t ,U t+ i, Y t ) =A\. (65) 

In block b, node t finds a set of w b -t+2 for which 

(u t -i(w b ^ t+2 ),ut{w b -t+i),ut+i(wb-t),ytb) G Ae(U t -i,Ut,Ut + i,Y t ) =A 2 - (66) 

Node t then finds the intersection of the two sets to determine the value of w b - t +2- 

Assuming that node t has correctly decoded w b _ t -i, w b _ t , and w b _ t +i, we define the following error events: 

(67a) 
(67b) 
(67c) 
(67d) 



£\ = (^u t _ 2 (w6--i + 2),u t _i(w b _ t+1 ),u t (w fe _i),u 4+ i(w fe _i_i),yi (6 _ 1) J ^ A\ 
£ 2 = (u t ^2(v),u t ^ 1 (w b - t+ i),vi t (w b -t),ut+i(wb-t-i),yt(b~i)) G Ai 
£ 3 = (u t ^i(w b -t+2),^t{w b -t+i),ut+i(w b -t),ytbj i A 2 
£4 = ^u t _i(u),Ui(^ 6 _ t+ i),u t+ i(w 6 „ t ),y tt ) G A 2 

for some v G ju G [1, . . . , 2 nR ] : v 7^ W6_t+2}> an d 

£5 — £2 n £4. 



(68) 
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<?5 is the event where v ^ w b _ t +2 is found in the intersection of the decoding sets and is, therefore, wrongly 
decoded as the transmitted message. An error occurs during the decoding in block b at node t if events £\, £3, or 
£5 occurs. Now, we can rewrite 

P et (b) = Pr{£t U£ 3 U £ 5 } < Pr{£!} + Pi{£ 3 } + Pr{£ 5 }- (69) 

The last equation is due to the union bound of events. 

From the definition of jointly typical sequences (Definition [5]), we know that 

Pr{£i} < e (70a) 
Pr{£ 3 } < e, (70b) 

for sufficiently large n. 

Using Lemma [TJ we derive the probability of a particular v / w b -t+2 that satisfies (167bl ): 

Pr|(u t _ 2 («),u t _i(t(;5_t + i),ut(u; 6 _t),ut + i(t!;6_ t _i),y t ( 6 _i)) G Aij 

= P(ut-2)p(u t _i,u t) u t+ i,y t ) (71a) 

(u t _ 2 ,u t _i,u t ,u t+ i,y t )e^ 1 

< \_A 1 \2- n ( H ( u ^-)-^2- n ^ H ^ Ut - 1 ' Ut ' Ut + 1 ' Yt ^ (71b) 

< 2 n(H(U t -2,U t ^ 1 ,U t ,U t+1 ,Y t )+e) 2 -n{H(U t -2)-e)2-n(H(U t - 1 ,U t ,U t+1 ,Y t )-e) 
_ 2 -< H (Ut- 2 )-H(U t - 2 \Y t ,U t . 1 ,U t ,U t+1 )-3e) 

< 2-n(I(Ut-2;Y t \Ut-i,U t ,U t+ i)-3e)_ 

The last equation is because H(Ut~ 2 ) > H{Ut~2\Ut~\, Ut, Ut+i). 

By a similar method, we can calculate the probability of a particular v G {v G {1, . . . ,2 nR } : v / Wb-t+2} 
satisfies (I67db : 

Pv{(n^ 1 (v 2 ),u t (w b _ t+1 ),u t+1 (w b _ t ),y tb ) G A 2 } < 2 -< r (K-^l^+0-3e)_ (72) 

Combining these two probabilities, we find the probability that node t wrongly decodes Wb-t+2 t0 any ^ G G 
{l,...,2 nR ]:v^w b _ t+2 } to be 

Pr{£ 5 } 

= Pr i v satisfies <g5)} (73a) 

i-e{i,...,2"«} 

= ]T Fr i v satisfies (l67bl } Pr{t> satisfies (l67db > (73b) 

ue{l,...,2 nH } 

1>^U;j,-t+2 

< ( 2 niJ - l) x 2~ n(/(c/ *- 2;yt| ' 7t - 1 '' 7t '' 7f + l) ~ 3£) 2" n(/( ' 7t - i;yt| ' 7t ' f/t+l) ~ 3e:) (73c) 

< 2-n(I(U t - 2 ,U t - 1 ;Y t \U t ,U t+1 )-6e-R) g^d) 

< e. (73e) 

Here, (173bb is due to the use of independent codebooks for each alternating block. The last equation is made 
possible for sufficiently large n and if 

R < I(U t - 2 ,Ut-i;Y t \U t ,U t+1 ) - 6e. (74) 
With this rate constraint and large n, we see that the probability of error is 

T 

P e {b) = Y J Pet{b) (75a) 

t=2 
T 

< + Pr{£ 3 } + Pr{£ 5 }] (75b) 

t=2 

< (T — l)3e, (75c) 



29 



which can be made arbitrarily small. Hence, the rate in d74l ) is achievable. 

Equation (l74l ) is only the rate constraint at one node. In two-hop myopic decode-forward, each message must 
be fully decoded at each node, hence the overall rate is constrained by 

R < mm R t , (76) 

~te{2,...,T} 

where 

R t = I(U^ 2 ,U t . 1 ;Y t \U t ,U t+1 ) (77) 

and Uo = Ut = Ut+i = 0. Since the message can flow through the relays in any order. Hence we arrive at 
Theorem |2] 

Appendix III 
Proof of Theorem [3] 

Now, we prove Theorem [3] We start by describing the codebook generation. We send B blocks of information 
over B + T — 2 blocks of channel use. 

A. Codebook Generation 

The codebook generation for /c-hop myopic decode-forward for the multiple -relay channel is as follows. 

• Fix the probability distribution function 

p(u 1 ,U 2 , . . . ,U T -l,X 1 ,X 2 , ■ ■ • ,XT-l) 
= P{ui)p{u 2 ) ■ ■ ■ p(u T -l)p(xT-l\uT-l) 

X p(xt- 2 \ut- 2 -,UT-i) ■ ■ ■ p(x T -k\uT-k,UT-k+l ■ ■ ■ , U T -\) 

x p(x T -k-i\ur-k-i,ur-k ■ ■ -,ut-2) • ■■p(x 1 \u 1 ,u 2 ,.. . ,u k ). (78a) 

• For each t € {1, . . . , T — 1}, generate 2 nR independent and identically distributed (i.i.d.) n-sequences in Up, 
each drawn according to jp(ut) = Yl2=i p( u u) ■ Index them as ut(zt), Zt E {1, ... , 2 nR }. 

• Define xt-i(zt-i) = ut-i(^t-i)- 

• For each t G [T — k, T — 2], define a deterministic function that maps (u t , Ut+\, ■ ■ ■ , ut-i) to x t : 

xj(z t , zt+i, ■ ■ ■ ,zt-x) = f t (u t (zt),u t+ i(z t+1 ), . . . ,u T -i(zt-i)). (79) 

• For each t £ [1, T — k — 1], define a deterministic function that maps (u*, u t +\, . . . , u t +k-i) to x t : 

x t (z t , zt+i, Zt+k-i) = ft(u t (z t ),u t+1 (z t+1 ), u t+fe _i(z t+fe _i)). (80) 

• Repeat the above steps to generate k — 1 new independent codebooks. These k codebooks are used in cycle 
and reused after k blocks of n transmissions. 

For the sake of illustration, we denote the code of node t, t € {1, . . . , T — 1} by Xt(zt, zt+i, • • • , zt+k-i) where 
Zj = 1 for j > T. These are dummy symbols that do not affect the encoding process. 

B. Encoding 

We now describe the encoding process for /c-hop myopic decode-forward. It is depicted in Fig. [25] 

• In the beginning of block 1, the source emits the first source letter w\. Note that there is no new information 
in blocks b fox B + I < b < B + T — 2. We assume that wb+i = wb+ 2 = • • • = wb+t-2 = 1- 

• In block 1, node 1 transmits xx(wi, Wo, ■ ■ ■ , w 2 -k)- Since the rest of the nodes have not received any information, 
they send dummy symbols Xj(u>2_j, w\-i, . . . , w^k-i), i £ {2, . . . , T — 1}. We define Wf, = 1, for b < 0. 

• At the end of block b — 1, b > 2, we assume that node t has correctly decoded messages up to Wb-t+i- 
Under the k-hop myopic constraints, a node can encode with at most k previously decoded messages in each 
block of transmission. So, in block b, node t encode min{/c, T — t} previously decoded messages, i.e., it sends 
~x.t{wb-t+i-, w b-t, ■ ■ ■ i Wb-t-k+2)- We note that there are only T — t nodes in front of node t. For the case of 
T — t < k, node t sends x. t (wb-t+i,Wb-t, • • • , Wb-T+2, 1 ; ■ ■ ■ , !)• This means, it sets W{ = 1 for i > b — T + 1, 
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x,(l, !,...,!) x(w., !,...,!) 



x ( (l,l,...,l) x/1, !,...,!) 



x (1, !,...,!) x (1, !,...,!) 
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x 7--i( w 6-m»^»-"jl) 



Fig. 25: The encoding scheme for £>hop myopic decode-forward for the multiple -relay channel. 

Block b-k+l Block 6-1 Blocks 



Node t-k 



Node t-2 
Node t-1 
Node t 



Fig. 26: The decoding scheme for /c-hop myopic decode-forward for the multiple -relay channel. Underlined 
symbols are those that has been decoded by node t prior to block 6. 



which is equivalent to sending dummy symbols. This is because at the end of block 6 — 1, node T will have 
already correctly decoded signals up to Wh-T+i- As this is the last node in the network, all other nodes will 
have had decoded those signals. Hence no node needs to transmit Wi = 1 for i > b — T + 1 again. The dummy 
symbols are included so that the same transmit notation can be used for all the nodes. 

C. Decoding and Achievable Rates of k-Hop Myopic Decode-Forward 

We look at how node t, for t > k + 1, decodes Wb-t+2 at the end of block b. Fig. [26] shows what the nodes 
transmit. 

• During block b, there are k nodes that encode Wb-t+2 in their transmissions. These are nodes {£ — k, . . . , t — 1}. 
Nodes {1, . . . ,t — k — 1} do not encode in their transmissions in block b as they have to discard the 
message due to the buffering constraint of the fc-hop myopic coding. 

• At the end of block b, node t finds Ci(wb-t+2) in which 

(u t _i(u) b _ t+2 ),u t (w fe _ t+1 ),...,u t+A .„i(u; 6 „ t „ fc+ 2),yife) eA™- (81) 

Here, we note that node t can store k old messages. Hence, during the decoding at the end of block b, it knows 
(u t (w b - t +i), • • • > VL t+k ^ 1 (w b ^ t -k+2))- The rate contribution from (ED is 

i?W =I(U t - 1 ;Y t \U t ,...,U t+k - 1 ). (82) 

• Moving back one block, at the end block 6 — 1, node t has messages (u t (wb-t), ■ ■ ■ , u t+ f.-x(wb-t-k+i)) in its 
storage. After decoding \it-i(wb-t+i), it then forms the set £2(^^+2) which 

(u t _ 2 {w b -t+2),ut-i(wb-t+i), ■ ■ ■ ,ut+k-i(wb-t-k+i),yt(b-i)) G A™. (83) 
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The rate contribution from this is 



Rl 2) =I(Ut-2;Y t \Ut- 1 ,...,U t+k - 1 ). (84) 



• Repeating this for blocks (6 — % + 1), 3 < % < k, node t find the set £j(u)fc_ t+2 ), and the rate contribution is 

Rf = I(U t -i] Y t \U t -i+i, • • • , Oi+fc-i). (85) 

The proof is similar to that for two-hop myopic decode-forward and will be omitted here. 

• Finally, node t finds G Di=i ^-ii^b-t+i) ^ where f] denotes the intersection of sets. A unique u>6-t+2 
can be found if the reception rate at node t is not more than 

k 

Rt = J2 R t ] = J (Ut-k, U t ^;Y t \U t , E/t+fc-i). (86) 

i=l 

• Since all data must pass through every node, the overall rate is constrained by the node which has the lowest 
reception rate, that is 

R< min R t . (87) 

fe{2,...,T} 

With this, we have Theorem [3j 
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